Method and apparatus for selectively presenting content

ABSTRACT

A machine-implemented method includes obtaining input data and generating output data. The status of at least one contextual factor is determined and compared with a standard. If the status meets the standard, a transformation is applied to the output data. The output data is then outputted to the viewer. Through design and/or selection of contextual factors, standards, and transformations, output data may be selectively outputted to viewers in a context-suitable fashion, e.g. on a head mounted display the viewer&#39;s central vision may be left unobstructed while the viewer walks, drives, etc. An apparatus includes at least one sensor that senses a contextual factor. A processor determines the status of the contextual factor, determines if the status meets a standard, generates output data, and applies a transformation to the output data if the status meets the standard. A display outputs the output data to the viewer.

CLAIM OF PRIORITY

This application claims the benefit of U.S. Provisional Application Ser.No. 61/695,261 filed on Aug. 30, 2012, the contents of which areincorporated by reference for all intents and purposes.

FIELD OF THE INVENTION

This invention relates to presentation of content. More particularly,the invention relates to selectively presenting content in a controlledfashion such as according to a visual map, in response to contextualfactors.

DESCRIPTION OF RELATED ART

In some instances, it may prove useful to output media content and otherinformation in a “bulk” fashion. That is, a computer monitor,television, smart phone display, etc. displays images, text, and soforth in an essentially continuous and uniform fashion. So long as sucha device is on, the device delivers data as that data is sent to thescreen.

However, such bulk delivery of content can be problematic. For example,for a head mounted display it may be desirable under some circumstancesto output at least certain types of data to the central visual field ofa person wearing the display, so as to take advantage of the high visualacuity of the wearer's central vision. Yet, there are also circumstancesunder which outputting data to the wearer's central vision may causedifficulty, such as when a wearer of such a device is walking along acrowded sidewalk; in such case it might prove more advantageous tominimize or prevent obstructions to the wearer's central vision, so thatthe wearer may safely navigate through their environment.

There is a need for a simple, efficient method and apparatus forselectively and/or interactively presenting content.

BRIEF SUMMARY OF THE INVENTION

The present invention contemplates a variety of systems, apparatus,methods, and paradigms for selectively presenting content.

In one embodiment of the present invention, a machine implemented methodis provided that includes obtaining input data, generating output datafrom the input data, determining the status of a first contextualfactor, and determining whether the status meets a first standard. Ifthe status of the first contextual factor meets the first standard afirst transformation to said output data. The method includes outputtingthe output data to a viewer.

If the status of the first contextual factor does not meets the firststandard, a second transformation may be applied to the output data.

The input data may be obtained from a sensor, a processor, a data store,and/or an external system.

The contextual factor me be a feature of the viewer. The contextualfactor may be a posture of the viewer and/or a gesture of the viewer.The contextual factor may be a hand posture, an eye posture, a lipposture, a tongue posture, a jaw posture, a head posture, a bodyposture, a hand gesture, an eye gesture, a lip gesture, a tonguegesture, a jaw gesture, a head gesture, a body gesture, and/or alocomotion. The contextual factor may be a voice input, a key input, amouse input, a stylus input, a joystick input, a touch input, a virtualinterface input, and a brainwave sensor input.

The head gesture may include nodding, shaking, tilting, and facing in adirection. The head posture may include a directional facing. The eyegesture may include aligning the line of sight with at least a portionof the output data, aligning the line of sight with a real-world target,aligning the line of sight with a virtual reality target, and/oraligning the line of sight with an augmented reality target. The eyeposture may include the line of sight being aligned with at least aportion of the first output data, the line of sight being aligned with areal-world target, the line of sight being aligned with a virtualreality target, and/or the line of being sight aligned with an augmentedreality target.

The contextual factor may include the viewer sleeping, sitting,standing, walking, running, conversing, exercising, operating a vehicle,and/or operating machinery.

The contextual factor may be an environmental feature. The environmentalfeature may include the level of illumination, the color ofillumination, the background brightness, the background color, thebackground motion, the location, the time, the date, an entity, anobject, a phenomenon, and/or a surrounding.

The contextual factor may include sensor data, visual data, and/orbiometric data. Sensor data may include accelerometer data, gyroscopedata, compass data, GPS data, and differential GPS data.

Determining the status of the first contextual factor may include facerecognition, object recognition, text recognition, and/or environmentalrecognition. Determining the status of the first contextual factor mayinclude sensing a color transition, a brightness transition, a distancetransition, and/or a focus transition.

The transformation may include at least partial determination of atleast one output property of the output data.

The transformation may include defining at least a first output regionand limiting output of the output data thereto. The first transformationmay include defining at least a first output region and excluding outputof said output data therein. The first output region may correspond to aregion of a visual field of the viewer. The output region maysubstantially correspond the foveolar region, foveal region, macularregion, central region, and/or peripheral region of the visual field ofthe viewer.

A first transformation may include defining a first output region andlimiting output of the output data thereto, with a second transformationincluding defining a second output region and limiting output of theoutput data thereto. The first output region may substantiallycorrespond to the central visual field of the viewer and substantiallyexclude the peripheral visual field of the viewer, and the second outputregion, may substantially correspond to the peripheral visual field ofthe viewer and substantially exclude the central visual field of theviewer.

The transformation may include definition of a first subset of saidoutput data with output of the output data limited to output of thatfirst subset. The transformation may include defining first and secondsubsets of output data, defining first and second output regions, andlimiting output of the first and second subsets respectively thereto.

The transformation may include at least partial determination of thepresence, location, size, abridgment, dimensionality, resolution, color,brightness, contrast, transparency, motion, speed, animation, and/orframe rate of the output data.

The output data may include text, graphics, images, video, and/or imageaugmentation. The output data may include sound.

The output data may include all of the input data, some of said inputdata, or none of said input data. The output data may be an empty set.

If the status of the first contextual factor does not meet the standard,generating the output data may include incorporating some but not all ofsaid input data in said output data, with the first contextual factorincluding a head motion toward at least a portion of the output data asoutputted, and the first transformation including incorporation of allof the input data in the output data.

The first contextual factor may include a head motion of the viewer,with the transformation including definition of a first output regionsubstantially excluding the central vision of the viewer, and withoutput of the output data limited thereto.

The method may include determining the status of a second contextualfactor, determining whether the status of the second contextual factormeets a second standard, and if the second contextual factor meets thesecond standard applying a second transformation to the output data.

The first transformation may have priority over said secondtransformation such that if the first contextual factor meets the firststandard and the second contextual factor meets the second standard thenonly the first transformation is applied to the output data. The firsttransformation may have priority over the second transformation suchthat if the first contextual factor meets the first standard and thesecond contextual factor meets the second standard then the secondtransformation is limited by the first transformation. The firsttransformation may have priority over the second transformation, suchthat if the first contextual factor meets the first standard and thesecond contextual factor meets the second standard then the secondtransformation is at least partially countered by the firsttransformation.

The first contextual factor may include a head motion substantiallycorresponding with locomotion of the viewer, with the firsttransformation including definition of a first output regionsubstantially excluding the central vision of the viewer and limitingoutput of the output data thereto, and with the second transformationincluding definition of the first output region but substantiallyincluding the central vision of said viewer therein.

The second contextual factor may include an abrupt head motion notsubstantially corresponding with locomotion of the viewer, asubstantially vertical head nodding motion not substantiallycorresponding with locomotion of the viewer, and/or a substantiallyhorizontal head shaking motion not substantially corresponding withlocomotion of the viewer.

The first contextual factor may include a head position of the viewerthat substantially corresponds to a near-distance reading position, andthe first transformation may include definition of a first output regionsubstantially below the horizon of the field of view of the viewer withoutput of the output data limited thereto.

The method may include outputting the output data in a stereo format,with the first transformation including definition of a naturalconvergence substantially corresponding to a natural reading position ofthe viewer with the output data displayed therewith.

The method may include outputting the output data in a region extendingbeyond the visual field of the viewer, such that the visual field of theviewer forms a window into the output data, and such that moving thevisual field of the viewer substantially correspondingly moves thewindow relative to the output data.

The method may include outputting a marker substantially fixed relativeto the visual field of said viewer, the marker moving substantiallycorrespondingly with the visual field of the viewer. The marker may be acursor.

In another embodiment of the present invention, an apparatus is providedthat includes at least one sensor adapted to sense at least onecontextual factor. The apparatus includes a processor in communicationwith the sensor, the processor being adapted to determine the status ofthe contextual factor, to determine if the contextual factor meets astandard, to generate output data from input data, and to apply atransformation to the output data if the contextual factor meets thestandard. The apparatus also includes a display in communication withthe processor, the display being adapted to output the output data to aviewer.

The contextual factor may include a feature of the viewer.

The sensor may include a position sensor, a motion sensor, and/or anacceleration sensor. The sensor may include an accelerometer, agyroscope, a compass, a GPS sensor, and/or a differential GPS sensor.The sensor may include a camera. The sensor may include a biometricsensor.

The sensor may be adapted to receive at least a portion of the inputdata and to communicate the input data to the processor.

The apparatus may include a communicator in communication with theprocessor, the communicator being adapted to receive at least a portionof the input data and communicate the input data to the processor,and/or to receive at least a portion of the status of the contextualfactor and communicate the contextual factor to the processor.

The apparatus may include a data store in communication with theprocessor, the data store being adapted to store at least a portion ofthe input data and communicate the input data to the processor, and/orto store at least a portion of the status of the contextual factor andcommunicate the contextual factor to the processor.

The processor may be adapted to generate at least a portion of the inputdata.

The display may be adapted to output the output data selectively to atleast one region substantially corresponding to a visual region of theviewer. The region may include the foveolar visual region, the fovealvisual region, the central visual region, the macular visual region,and/or the peripheral visual region of the viewer. The display may beadapted to output data selectively to exclude at least one regionsubstantially corresponding to a visual region of the viewer. The regionmay include the foveolar visual region, the foveal visual region, themacular visual region, the central visual region, and/or the peripheralvisual region of the viewer.

The display may be disposed in front of and proximate one or both eyesof the viewer. The display may be a stereo display.

In another embodiment of the present invention, a machine implementedmethod is provided that includes obtaining input data from a sensor, aprocessor, a data store, and/or an external system, and generatingoutput data from the input data. The method includes determining withsensor data the status of a contextual factor that includes a feature ofa viewer, and determining whether the status of the contextual factormeets a standard. If the contextual factor meets the standard, a firsttransformation is applied to the output data, the first transformationincluding defining at least a first output region and excluding outputof the output data therefrom, the first output region substantiallycorresponding to the foveolar region, foveal region, macular region,central region, and/or peripheral region of the visual field of theviewer. The method also includes outputting the output data to theviewer.

In another embodiment of the present invention, a head mounted displayis provided that includes a body adapted to be worn on the head of aviewer, and at least one sensor adapted to sense a contextual factor.The apparatus also includes a processor in communication with thesensor, the processor being adapted to determine the status of thecontextual factor, to determine if the contextual factor meets astandard, to generate output data from input data, and to apply atransformation to the output data if the contextual factor meets saidstandard. The apparatus includes a display engaged with the body suchthat when the body is worn, the display is disposed proximate to andsubstantially aligned with one or both of the viewer's eyes, the displaybeing in communication with the processor and being adapted to outputthe output data to the viewer.

The sensor may be engaged with the body. The processor may be engagedwith the body.

In another embodiment of the present invention, a head mounted displayis provided that includes a body adapted to be worn on the head ofviewer, and a plurality of sensors engaged with the body and adapted tosense a plurality of contextual factors, the contextual factorsincluding the position of at least a portion of the viewer, the motionof at least a portion of the viewer, the acceleration of at least aportion of said viewer, and an image having an imaging field of viewsubstantially corresponding with the viewer's visual field. Theapparatus includes a communicator engaged with the body and a data storeengaged with the body. The apparatus also includes a processor engagedwith the body and in communication with the sensors, the communicator,and the data store, the processor being adapted to determine the statusof each contextual factor, to determine whether each contextual factormeets a standard therefor, to generate output data from input data fromat least one of the sensors, the communicator, and/or the data store,and to apply a plurality of transformations corresponding to thecontextual factors to the output data for each contextual factor thatmeets the standard therefor. The apparatus further includes a stereodisplay engaged with the body such that when the body is worn, thedisplay is disposed in front of and proximate to the viewer's eyes, thedisplay being in communication with the processor and being adapted tooutput the output data to the viewer. The stereo display is also adaptedto output the output data selectively to at least a first regionsubstantially corresponding to foveolar, foveal, central, macular,and/or peripheral visual region of the viewer. The stereo display isfurther adapted to output the output data selectively to exclude atleast one region substantially corresponding the foveolar, foveal,central, macular, and peripheral visual region of the viewer.

In another embodiment of the present invention, an apparatus is providedthat includes means for obtaining input data, means for determining astatus of a contextual factor, means for determining whether the statusof the contextual factor meets a standard, means for generating outputdata from the input data, means for applying a transformation to theoutput data if the contextual factor meets the first standard, and meansfor outputting the output data to a viewer.

In another embodiment of the present invention, a machine implementedmethod is provided that includes defining a contextual factor in aprocessor, defining a standard for the contextual factor in theprocessor, and defining a transformation in the processor. The methodalso includes instantiating in the processor executable instructions fordetermining the status of the contextual factor, instantiating in theprocessor executable instructions for obtaining input data, andinstantiating in the processor executable instructions for generatingoutput data from the input data. The method further includesinstantiating in the processor executable instructions for determiningwhether the status of the contextual factor meets the first standard,instantiating in the processor executable instructions for applying thefirst transformation to the output data if the status of the firstcontextual factor meets the first standard, and instantiating in theprocessor executable instructions for outputting the output data.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Like reference numbers generally indicate corresponding elements in thefigures.

FIG. 1 shows an embodiment of a method for selectively outputting datato a viewer according to the present invention.

FIG. 2 shows a visual map of a typical human eye including peripheraland central vision.

FIG. 3 shows a partial visual map of a typical human eye includingmacular, foveal, and foveolar vision.

FIG. 4 shows another embodiment of a method for selectively outputtingdata to a viewer according to the present invention.

FIG. 5 shows an arrangement of output data with respect to typical humanvisual fields.

FIG. 6 shows an arrangement of output data excluding the peripheralvisual field.

FIG. 7 shows an arrangement of output data excluding the central visualfield.

FIG. 8 shows an arrangement of output data excluding the macular visualfield.

FIG. 9 shows an arrangement of output data excluding the foveal visualfield.

FIG. 10 shows an arrangement of output data excluding the foveolarvisual field.

FIG. 11 shows an arrangement of output data limited to the peripheralvisual field.

FIG. 12 shows another arrangement of output data limited to theperipheral visual field.

FIG. 13 shows an arrangement of output data limited to the centralvisual field.

FIG. 14 shows another arrangement of output data limited to the centralvisual field.

FIG. 15 shows an arrangement of output data limited to the macularvisual field.

FIG. 16 shows an arrangement of output data limited to the foveal visualfield.

FIG. 17 shows an arrangement of output data limited to the foveolarvisual field.

FIG. 18 shows an arrangement of output data with a viewer's visual fieldin a neutral position.

FIG. 19 shows an arrangement of output data with a viewer's visual fieldpanned left.

FIG. 20 shows an arrangement of output data with a viewer's visual fieldtilted up.

FIG. 21 shows an arrangement of output data with a viewer's visual fieldinclined counterclockwise.

FIG. 22 shows an arrangement of output data including a cursor as atarget.

FIG. 23 shows an embodiment of a method for selectively outputting datato a viewer according to the present invention, having a firsttransformation with a positive status and a second transformation with anegative status.

FIG. 24 shows an embodiment of a method for selectively outputting datato a viewer according to the present invention, transforming output to afirst region with a positive status and a second region with a negativestatus.

FIG. 25 an embodiment of a method for selectively outputting data to aviewer according to the present invention, transforming first and secondsubsets of output to first and second regions with a positive status.

FIG. 26 an embodiment of a method for selectively outputting data to aviewer according to the present invention, limiting output to a firstsubset with a positive status.

FIG. 27 an embodiment of a method for selectively outputting data to aviewer according to the present invention, showing equal precedencebetween first and second transformations.

FIG. 28 an embodiment of a method for selectively outputting data to aviewer according to the present invention, showing a firsttransformation with full precedence over a second transformation.

FIG. 29 an embodiment of a method for selectively outputting data to aviewer according to the present invention, showing a firsttransformation with partial precedence over a second transformation.

FIG. 30 shows an embodiment of an apparatus for selectively output datato a viewer according to the present invention.

FIG. 31 shows an embodiment of an apparatus for selectively output datato a viewer according to the present invention, with stereo sensors andstereo displays.

FIG. 32 shows an embodiment of an apparatus for selectively output datato a viewer according to the present invention, with a data store andcommunicator.

FIG. 33 shows an embodiment of an apparatus for selectively output datato a viewer according to the present invention, in the form of a headmounted display.

FIG. 34 shows an arrangement for establishing in a processor an exampleembodiment of a method for selectively outputting data to a vieweraccording to the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Referring to FIG. 1, an embodiment of a method according to the presentinvention for selectively outputting data to a viewer is shown therein.In the method as shown in FIG. 1, input data is obtained 110. A widerange of data may be suitable for utilization as input data, includingbut not limited to text, video, audio, and numerical data.

Output data is generated 112. Typically though not necessarily theoutput data is at least partially derived from and/or includes at leasta portion of the input data. However, even when input data is a sourcefor output data, information present in input data may be added,modified, and/or or removed when generating output data 112. A widevariety of approaches, algorithms, etc. may be used to generate outputdata 112. The approaches, algorithms, etc. used to generate output data112 may depend at least in part on the desired form and/or content ofthe output data. That is, whether or not the output data is or includes(for example) video data may at least partially determine the manner bywhich the output data is generated 112. In addition, where output datais generated from input data, the approaches, algorithms, etc. used togenerate output data 112 therefrom may depend at least in part on theform and/or content of the input data. To continue the example above,whether the input data includes video data may at least partiallydetermine the manner by which the output data is generated 112 from theinput data.

Moving on in FIG. 1, a status of a contextual factor is determined 114.As applied to the present invention, contextual factors may varygreatly. Although particular embodiments may preferentially utilize oneor more specific contextual factors, in general substantially any event,object, feature, etc. that may be sensed or otherwise evaluated may beutilized as a contextual factor for the present invention.

Consider a case wherein a person is viewing data on aprocessor-controlled head mounted display device wherein the processoris executing the method as described herein.

In such circumstance, one example of a contextual factor might be thelocomotion (if any) of the viewer. Such a contextual might also beconsidered in a more detailed fashion, for example with regards toparticular head motions and/or features thereof, which might beindicative of whether the viewer is walking, running, sitting, etc.Other contextual factors might include but are not limited to a viewer'sbody position, a location in real space (or an augmented space and/or avirtual space), conditions such as light level, the presence or absenceof objects, persons, and/or phenomena, etc.

Determining the status of a contextual factor 114 thus might beexpressed as a question, e.g. “does the viewer's head exhibit motionscorresponding with the viewer walking?” A question addressing such acontextual factor also might be phrased more generally, e.g. “is theviewer walking?”

If determining the status of a contextual factor 114 may be consideredas a question, the status itself of a contextual factor may beconsidered in the form of an answer to that question. For example, ifthe contextual factor is “viewer's locomotion”, a status might be dataregarding the motion of the viewer's head, the viewer's body as a whole,etc.

The present invention is not particularly limited with regard to thecontextual factor, the status the contextual factor may have, or howthat status is determined.

Returning to FIG. 1, a determination is made 118 as to whether thestatus of the contextual factor (as determined in step 114) meets astandard for that contextual factor. To continue the example above, ifthe contextual factor at issue is “viewer's locomotion”, and the statusof the contextual factor is in the form of data regarding the motion ofthe viewer's head and/or body, this standard might take the form of aseries of guidelines representing motions that would be expected if theviewer were walking, running, etc. Standards may be simple, such as afixed minimum value of acceleration or velocity, or relatively complex,such as a detailed set of criteria regarding directions of motion,amplitudes, patterns (if any), speeds and/or frequencies of motion, etc.

In addition, although a determination 118 may be binary as shown in FIG.1—that is, the status of the contextual factor either meets or does notmeet the standard—this is an example only. More nuanced determinations118 may be made, using non-binary standards. For example, a standardmight have several levels or degrees, such as an arrangement wherein astandard for acceleration has ranges for “no acceleration”, “lowacceleration”, and “high acceleration”, potentially with differenttransformations and/or other outcomes associated with each level. Otherarrangements, including but not limited to standards that definecontinuous ranges as opposed to discrete levels also may be suitable.

Alternatively, multiple standards may be used in combination withmultiple transformations. That is, a single contextual factor may becompared against two or more standards, with each standard potentiallyleading to a distinct transformation.

Moreover, a transformation may be based at least in part and/orotherwise take into consideration the status and/or value of thecontextual factor. For example, a transformation relating to a minimumlevel of acceleration may include the value, direction, etc. as measured(or otherwise determined) for the acceleration as part of an algorithmused to carry out the transformation.

Briefly, then, a contextual factor is a feature to be evaluated; thestatus of the contextual factor is information describing some or all ofthe state of that feature; and the standard is a guideline (simple orcomplex) against which that information may be compared.

The contextual factor, the status thereof, the standard for comparison,and the manners by which the status is determined and compared, may allvary considerably from one embodiment to another. The particularsthereof may depend at least partly on the details of each specificembodiment. These matters are addressed in more detail subsequentlyherein.

If the determination 118 is negative—the status of the contextual factordoes not meet the standard therefor—then the method proceeds to outputthe output data 130. In the head mounted display used as an exampleabove, the output data might be displayed to the viewer on a screen orscreens.

On the other hand, if the determination 118 is positive—the status ofthe contextual factor does meet the standard—then the method proceeds toapply a transformation to the output data 124. The present invention isnot particularly limited with regard to the transformation.Transformations might include, but are not limited to, changes to and/orrestrictions on where data is displayed, how much (if any) data isdisplayed, the form in which data is displayed (e.g. text, graphicalicons, still images, video, audio, etc.), and the appearance of the data(color, size, resolution, frame rate of animation, etc.).

Subsequent to application of the transformation 124, the now-transformedoutput data is outputted to the viewer 130.

Further and more detailed discussion follows regarding several of theaforementioned features. However, for the sake of clarity a moreconcrete example of a method according to the present invention willfirst be presented with reference to FIG. 2, FIG. 3, and FIG. 4. FIG. 2and FIG. 3 illustrate portions of a human visual field, while FIG. 4shows an example method according to the present invention forselectively outputting data to different portions of a human visualfield.

With reference to FIG. 2, therein a visual map 200 is presented showingvisual fields typical for the right eye of a human. Hash marks atdifferent radial distances correspond to angles from the normal, e.g. 20degrees offset, 40 degrees offset, etc. Hash marks around the peripheryof FIG. 2 correspond to angles from the vertical.

The outline identified as 202 in FIG. 2 corresponds approximately to ahuman's peripheral visual field. The outline identified as 204 in FIG. 2corresponds approximately to a human's central visual field.

The human peripheral visual field 202 is of uneven shape, and covers arelatively large area, with a radial extent of as much as 120 degrees ormore in some areas as may be seen in FIG. 2. Within the area of theperipheral visual field 202, spatial resolution is low and colordiscrimination is poor or even nonexistent. However, vision at low lightlevels is good, and motion detection is excellent.

By contrast, the human central visual field 204 is roughly circular buthas a radial extent of only about 9 degrees (or a diameter of about 18degrees). In terms of physical dimensions within the eye, the region ofthe retina that generates the central visual field 204 is approximately5 mm in diameter. Within the central visual field 204, spatialresolution is high and color resolution is good. However, as noted thetotal area of the central visual field is relatively small. While humansgenerally perceive their vision as having high resolution over a widearea, this is for the most part an illusion generated by the brain; infact high resolution image data (and good color data) are available onlyin a small portion of the human visual field.

As may be seen in FIG. 3 the central visual field 304 may in turn befurther subdivided. The outermost portion of the central visual field304 is referred to as the macular vision 305; macular vision has aradial extent of about 9 degrees, and is generated by a region of theretina (the macula) approximately 5 mm across. Moving inward, the fovealvisual field 306 has a radial extent of about 3.5 degrees, and isgenerated by a region of the retina (the fovea) approximately 1.5 mmacross. Finally, the foveolar visual field 308 has a radial extent ofonly about 0.75 degrees, and is generated by a region of the retina (thefoveola) approximately 0.35 mm across.

The macular visual region 305, foveal visual region 306, and foveolarvisual region 308 respectively have progressively higher spatialresolution and improved color discrimination. That is, the highest levelof spatial resolution and color discrimination in human vision is foundin the foveolar visual region 308, corresponding to the centermostportion of the visual field.

Turning now to FIG. 4, a method according to the present invention isshown therein for selectively outputting data to different portions of ahuman visual field. The method of FIG. 4 is at least somewhat similar tothat shown in FIG. 1, however the method in FIG. 4 is more specific to aparticular embodiment. Namely, the example method in FIG. 4 relates todisplaying video in different areas of a viewer's visual field based ona determination of whether the viewer is walking. Such a method might beemployed, for example, in conjunction with the use of a head mounteddisplay worn by the viewer. However, it is emphasized that this is anexample only, presented for illustrative purposes, and that the presentinvention is not limited to the specifics of the embodiment shown inFIG. 4.

In the method as shown in FIG. 4, input video data is obtained 410. Thiscorresponds generally to the input data obtained in step 110 of FIG. 1,but for the example of FIG. 4 the input data is specifically data fordisplaying a video, i.e. video frames, video encoding information, audiotracks, etc.

Output video is generated 412 from the input video data. The generationof output video 412 from input video data is at least somewhatcomparable to the generation of output data 112 in FIG. 1. Output videomay be considered to be one possible example of output data (thoughoutput data for the present invention is not limited only to video).

The viewer's head motion is determined 414. That is, some or all of themotions of the viewer's head are determined e.g. using gyroscopes andaccelerometers or through some other approach. The determination of thestatus of the viewer's head motion 414 is at least somewhat comparableto the determination of the status of a contextual factor 114 in FIG. 1.Specifically, a viewer's head motion may be considered to be the statusof a contextual factor (though by no means the only possible contextualfactor or status thereof) for the particular example embodiment shown inFIG. 4.

Moving on in FIG. 4, a determination is made 418 as to whether thestatus of the viewer's head motion matches a walking motion standard.That is, is the viewer's head moving, and if so does that movementcorrespond with a standard representative of motions by a viewerwalking? For example, a walking viewer might be expected to exhibitspecific frequencies and amplitudes of head motion, and/or otherrecognizable patterns or properties of motion, which might be used todefine a standard by which make the determination 418. The determination418 as to whether the status of the viewer's head motion meets astandard is at least somewhat comparable to the determination 118 ofwhether the status of a contextual factor meets a standard in FIG. 1.

If the viewer's head motion is determined 418 not to match the standardtherefor, the method proceeds display the output video to the viewer430. This is at least somewhat comparable to outputting the output data130 in FIG. 1, in that displaying output video 430 may be considered anexample of outputting output data 130.

On the other hand, if the determination 418 is positive—if the viewer'shead motion does meet the standard therefor—then the method limits theposition in which the output video is displayed to the viewer to onlythe viewer's peripheral vision 424. This is at least somewhat similar tothe step of applying a transformation to output data 124 in FIG. 1, inthat limiting the position of output video may be considered as anexample of a transformation applied to output data. However, the presentinvention is not limited only to spatial limits as transformations.

With the positioning limit applied 424, the output video is displayed tothe viewer 430. More particularly, given the positioning limit of step424 the output video, the output video is displayed 430 only to theperipheral visual region of the viewer.

In sum, in the example method shown in FIG. 4, if the viewer is walking,then video output is limited to the viewer's peripheral vision, leavingthe viewer's central visual field clear to navigate, deal withobstacles, etc.

As noted earlier, additional discussion may be warranted with regard toseveral features of the present invention as introduced in FIG. 1.

With reference to step 110 in FIG. 1, further discussion is hereinpresented regarding input data in the context of the present invention.

A wide variety of input data may be suitable for use with the presentinvention, and the present invention is not particularly limited withregard thereto. Input data may include, but are not limited to, text,graphics, images, videos, models and/or other constructs, metadatarelated to any of the preceding or to other data, executableinstructions and/or programs composed thereof, and numerical data. Inaddition, nonvisual data may be suitable for use as input data for atleast some embodiments of the present invention, including but notlimited to audio data.

Similarly, the present invention is not particularly limited with regardto how and/or from what source(s) input data is acquired. Input datamay, for example, be obtained from one or more sensors, e.g. sensors incommunication with a processor that is executing the machine-controlledmethod of the present invention. A wide range of sensors may besuitable. Where sensors are used to generate input data, the particularsensors used to generate the input data for a given embodiment maydepend at least in part on the contextual factor(s) under consideration,i.e. the object, phenomenon, etc. on which the sensors gatherinformation. For example, for an embodiment wherein the contextualfactor is or relates to motion of a viewer's body, sensors fordetermining position, motion, and/or acceleration might be utilized.Other arrangements may be equally suitable.

As described in more detail elsewhere herein, sensors may also be usedto determine the status of contextual factors. It is noted that sensors,when present, may obtain either or both input data and statusinformation regarding contextual factors. Any particular sensor may, butis not required to, provide both types of data. For example, an imagingsensor might acquire images of a viewer's physical surroundings for useas input data, and also acquire information regarding the viewer's ownmotions if those motions are to be utilized as a contextual factor (e.g.by observing apparent motion of objects within the imager's field ofview). However, this is an example only and is not required, and otherarrangements also might be equally suitable.

Still with reference to step 110 in FIG. 1, in addition to or instead ofobtaining input data from sensors, input data may be generated within aprocessor that is implementing the machine-controlled method. Input datamight also be obtained from a data store in communication with theprocessor, or from an external system (e.g. by wired or wirelesscommunication). Input data may come from alternative and/or additionalsources, as well.

With reference now to step 112 in FIG. 1, further discussion is hereinpresented regarding output data in the context of the present invention.

The present invention generate a wide variety of output data, and thepresent invention is not particularly limited with regard thereto.Output data may include, but are not limited to, text, graphics, images,videos, models and/or other constructs, metadata related to any of thepreceding or to other data, executable instructions and/or programscomposed thereof, and numerical data. In addition, nonvisual data may besuitable for use as output data for at least some embodiments of thepresent invention, including but not limited to audio data.

Likewise, the present invention is not particularly limited with regardto how output data is generated. A wide variety of algorithms,processing approaches, etc. may be suitable for use in generating outputdata according to the present invention. The particular algorithms,processing approaches, etc. may depend at least to some degree on thecontextual factor(s) and standards therefor; for a binary standard (e.g.yes/no) for example, a simple algorithm may be suitable, while for astandard that providing subtle and sophisticated guidelines regardingcomplex motions a relatively complicated algorithm might be suitable.

In addition, for some embodiments it may be sufficient to use the inputdata directly as the output data, without alteration. Processing to makechanges to the input data to generate the output data, while notprecluded, also are not required. Thus for some embodiments under atleast some conditions, the input data and output data may be identicalor substantially identical.

Similarly, the present invention is not particularly limited with regardto how and/or to what destination(s) output data is outputted (withreference to step 130 in FIG. 1). Output data may be outputted to one ormore visual displays, such as visual displays in head mounted displaysand other wearable devices, but this is an example only and otherarrangements may be equally suitable. A wide range of output devices maybe suitable, and the particular form(s) and content of the output datafor a given embodiment may depend at least in part on the outputdevice(s) utilized therewith.

Furthermore, output data for the present invention is not necessarilystatic in nature. That is, it may be possible for at least someembodiments to generate output data with or without applying atransformation (depending on whether or not the status of any relevantcontextual factors matches the appropriate standards therefor), andthen, if the status of the relevant contextual factors is determined tochange, to likewise apply different transformations to the output data.For example, consider an arrangement wherein a contextual factor relatesto whether or not a viewer's line of sight is aligned with output databeing outputted to that viewer. Initially, until output data is firstoutputted the viewer might not be looking in appropriate direction(since the output data would not yet be present). However, once theoutput data were outputted, and the viewer aligned his or her line ofsight with the output data, the status of the contextual factor wouldchange, which in turn could invoke a transformation to the output data.More particularly, in terms of the appearance to the viewer, output datamight be displayed initially in an abbreviated form, with the outputdata then expanding to show more information when the viewer shifts hisor her eyes to focus on the output data.

With reference now to steps 114 and 118 in FIG. 1, further discussion isherein presented regarding contextual factors, status of contextualfactors, and standards therefor in the context of the present invention.

Contextual factors, the status thereof, and standards therefor areinterrelated. In brief, a contextual factor is a parameter to beconsidered; the status of the contextual factor is informationdescribing some or all of the state of that parameter; and the standardis a guideline against which that information may be compared. Forexample, a contextual factor might be “motion of a person viewing outputfrom a head mounted display”, with the status of that contextual factorbeing the actual motion exhibited by that viewer, and the standard beingsome description of motion against which the actual motion may becompared.

Contextual factors for the present invention may vary greatly, and thepresent invention is not particularly limited with regard thereto.Broadly speaking, a contextual factor for the present invention may besubstantially any feature that can be usefully sensed, measured orotherwise have a status thereof determined, and for which that statuscan be compared to a standard, so as to inform whether or not atransformation of output data is to be invoked.

Contextual factors, statuses, and standards may be simple or complex.For example, a contextual factor relating to light levels might be assimple as “light intensity”, but might also more sophisticated, e.g.“cyclical variation in light intensity over time”. In addition,contextual factors, statuses, and standards may consider multiplevalues, e.g. a contextual factor may consider both light level and lightcolor, both light level and motion of a viewer, etc. with statuses andstandards being similarly multi-value.

Contextual factors and standards may be viewer defined, may be processordefined, may be externally defined, and/or may be predefined. Contextualfactors and standards may also be adaptive. That is, contextual factors,statuses, and standards may themselves vary, e.g. in response to viewerinputs, processor action, environmental cues, etc. Contextual statuses,by contrast, typically are measured, read from storage, or otherwisedetermined as factual information, rather than being defined.

A minimum of one contextual factor, one status, and one standard arerequired for the present invention. However, there is no upper limitingnumber of contextual factors, statuses, and/or standards. In practicethe number considered for at least some embodiments may be extremelylarge. In addition, a single contextual factor, status, and/or standardmay invoke one or more transformations, and a single transformation mayconversely be invoked by more than one contextual factor, status, and/orstandard. While one-to-one correspondence is not prohibited, neither isone-to-one correspondence required.

Still with reference to steps 114 and 118 in FIG. 1, the manner by whichthe contextual factors and/or standards are defined or otherwisedetermined is not particularly limited. Likewise, the manner by whichthe status is measured or otherwise determined is not particularlylimited. Further, the manner by which the status is determined to matchor not match the standard is not particularly limited. Algorithms,approaches, etc. for the aforementioned actions may be simple orcomplex, may be viewer determined or otherwise determined, and may befixed or adaptive. Specific algorithms, approaches, etc. for aparticular embodiment may depend to at least some degree on the detailsof the contextual factors, statuses, and standards for that particularembodiment.

As previously noted with regard to input data, contextual feature statusmay be obtained as sensor data. In particular, for some embodiments someor all sensor data for input data and some or all sensor data fordetermining contextual status may come from one or more common sensors.That is, a single sensor may provide input data and/or contextual statusdata.

As has been described, contextual factors, statuses, and standards areinterrelated. For purposes of simplicity in describing variations andpermutations therein, the term “contextual factor” is used tocollectively represent these related concepts. It should be understoodthat reference to a contextual factor related to, for example, biometricfeatures and/or information, in turn implies a status that is likewiserelevant to biometric information, and a standard that similarly relatesto biometric features and/or information.

Contextual factors may vary greatly from one embodiment to another.

For at least some embodiments of the present invention, it may be usefulto utilize contextual factors that relate to a viewer of the outputdata, and/or that represent some feature of that viewer.

More particularly, for at least some embodiments of the presentinvention it may be useful to utilize one or more postures and/orgestures of the viewer as a contextual factor. As used with reference tothe present invention a posture is a substantially static position,orientation, configuration, etc. of a viewer or a portion thereof, whilea gesture is a substantially active change in position, orientation,configuration, etc. of a viewer or a portion thereof.

For example, a contextual factor might be a hand posture and/or gestureby the viewer. As indicated previously, contextual factors may be simpleor complex. Thus utilizing a hand posture or gesture as a contextualfactor might constitute simply determining whether a viewer's hand ispresent (and in the case of a gesture, moving), e.g. in the field ofview of a camera. However, the contextual factor could be more specific,such as determining whether a viewer's hand is present (and/or moving)at a certain location, with a certain orientation, a certainconfiguration (e.g. fingers bent, fingers spread, etc.).

Continuing with regard to steps 114 and 118 in FIG. 1, it is noted thatthe present invention does not necessarily require a distinction betweencontextual factors satisfied through a knowing and deliberate action onthe part of a viewer and contextual factors satisfied without the viewernecessarily intending or even being aware of satisfying a contextualfactor. To continue the example of hand postures and gestures, adeliberate hand posture or gesture might be executed by a viewer as aform of command or input (i.e. to the processor executing the method).By contrast, viewers may execute natural postures and/or gestureswithout consideration or even awareness of the use of those posturesand/or gestures as contextual factors. Thus, while certain contextualfactors may be selected so as to facilitate deliberate inputs orcommands by a viewer (e.g. to execute a particular transformation),other contextual factors may be selected so as to invoke transformationsthat are, from the standpoint of the viewer, transparent and automatic.

Thus, while certain a contextual factor in the present invention may forcertain embodiments represent a command, contextual factors are notrequired to be commands. In particular, it is emphasized that the use ofa viewer features and other viewer-controlled contextual factors is anexample only, and that the present invention is not limited thereto.Contextual features are possible that do not involve viewers and/or thatcannot be directly controlled by viewers, such as local temperature,light levels, time of day, etc.

Still with regard to steps 114 and 118 in FIG. 1, a variety of posturesand gestures may be suitable for use as contextual factors. Suitablegestures and postures include, but are not limited to, eye postures andgestures, lip, jaw, and/or tongue postures and gestures, head posturesand gestures, and overall body postures and gestures. In particular,postures and/or gestures indicative and/or suggestive of some otherviewer action (perhaps one not immediately observed) may be utilized ascontextual factors.

For example, lip, jaw, and/or tongue postures and gestures may beconsidered as contextual factors in their own right. However, certainlip, jaw, and/or tongue postures and gestures also may be considered tobe indicative of a viewer conversing, and/or subvocalizing. For someembodiments it may be sufficient to sense and consider as contextualfactors such lip, jaw, and/or tongue postures and gestures, withoutconsideration as to whether speech etc. is occurring. However, for otherembodiments it may be desirable to sense lip, jaw, and/or tonguepostures and gestures so as to determine therefrom whether a viewer isspeaking, and/or what he or she is saying if so. While suchdetermination is not required, neither is such determination prohibited.Either or both of the postures and/or gestures themselves and/or thespeech (if any) associated therewith may be utilized as contextualfactors for the present invention.

Other head postures and/or gestures suitable for use as contextualfactors include, but are not limited to, nodding, shaking, and/ortilting of the head, and/or moving to, moving from, moving through,and/or being aligned with a directional facing. More particularly withregard to directional facings, directional facings may include but arenot limited to head positions substantially corresponding with anear-distance reading position.

Similarly, eye alignment and/or eye movement may be considered ascontextual factors. A viewer aligning his or her line of sight, and/ormoving his or her line of sight, may be indicative of the viewer lookingat some target within the viewer's visual field such as object, feature,etc. It may not be necessarily to verify directly that a viewer isindeed looking at a particular object; for at least certain arrangementsit may be suitable to track the position and/or motion of the viewer'seyes, for example, and infer the viewing of a particular target based onthe direction(s) in which the viewer is looking. However, otherwisedetermining or verifying that the viewer is indeed looking at a target(e.g. though sensing degree/distance of eye focus, monitoringbrainwaves, imaging and recognizing objects within the viewer's field ofview, etc.).

Suitable eye postures include, but are not limited to, the viewer's lineof sight being aligned with the output data (or some portion thereof),the viewer's line of sight being aligned with a real-world target, theviewer's line of sight being aligned with a virtual reality target, andthe viewer's line of sight being aligned with an augmented realitytarget. Similarly, suitable eye gestures include but are not limited toaligning the viewer's line of sight with the output data (or someportion thereof), aligning the viewer's line of sight with a real-worldtarget, aligning the viewer's line of sight with a virtual realitytarget, and aligning the viewer's line of sight with an augmentedreality target.

Likewise, postures and/or gestures using other body parts and/or a bodyas a whole may be utilized as contextual factors.

Continuing with regard to steps 114 and 118 in FIG. 1, although thepreceding may refer (at least in places) to contextual factors on alevel of individual gestures, it is noted that contextual factors forthe present invention, including but not limited to contextual factorsassociated with viewer features such as postures and gestures, may beconsidered at varying “levels”. For example, a relatively low-levelcontextual factor might be represented by a characterization of certainspecific acceleration and gyroscopic parameters for a viewer's head. Ahigher-level contextual factor might be represented by a determinationof whether a viewer's head may be considered to be moving in such afashion as to correspond with that viewer walking and/or running. A yethigher-level contextual factor might simply be a question of whether theviewer is walking/running or not. In practice, a contextual factor suchas “viewer walking/running” may be implemented as one or more lowerlevel contextual factors, e.g. gyroscope and accelerometer data.Nevertheless, in instances where contextual factors may be implementedat high levels, doing so is not prohibited. For purposes of clarity,contextual factors as discussed herein may be presented as only a singlelevel. However, description of contextual factors at one level (whetherhigh, low, or otherwise) should not be interpreted as a requirement toimplement that contextual factor or any contextual factor at such alevel, nor should such description be interpreted as a suggestion thateither contextual factors generally or any particular contextual factoris limited to high levels, low levels, or otherwise.

Thus, while it may be suitable to consider specific motions and/orpositions of arms, legs, head, etc. (and/or combinations thereof) ascontextual factors, it may also be equally suitable to consider ascontextual factors such higher-level notions as whether a viewer issitting, standing, walking, running, conversing, exercising, operating avehicle, operating machinery, etc.

Again with regard to steps 114 and 118 in FIG. 1, insofar as determiningthe status of a particular contextual factor, data may be, but is notrequired to be, relatively low-level in nature. In practice sensorsavailable for obtaining status data tend to generate relativelylow-level data. For example, even if the high-level contextual factorunder consideration is “is the viewer walking?” the actual status datamay not be of a form “yes/no”, but rather may be of the form of visualdata (e.g. from a camera, whether facing the viewer or otherwise),biometric data, accelerometer data, gyroscope data, compass data, GPS ordifferential GPS data, etc. To consider a slightly higher level, datamight be in the form of position information, motion information,acceleration information, etc. The “yes/no” status may then bedetermined from such lower-level sensor data and/or such mid-level data,e.g. by analysis of the data using executable instructions instantiatedon the processor that is executing the method. However, this is anexample only, and obtaining high-level status information is notprohibited.

While processing of sensor and/or other data to determine the status ofa contextual factor is not required, for at least certain embodimentssuch processing may be useful. For example, data from an imaging sensor,or image data obtained otherwise, may be evaluated in terms ofrecognizable content therein. For example, for a contextual factor alongthe lines of “is another person present?”, evaluating an image using afacial recognition algorithm might prove useful in determining whether aface (and thus potentially a person) might be present. Likewise, objectrecognition might be utilized to assist in determining the presence ofobjects relevant to a contextual factor. Text recognition also may beuseful in evaluating contextual factors for at least some embodiments,since textual cues are frequently widespread and may be informativeeither directly and/or indirectly. For example, a sign reading “East46th Street” might be directly indicative of location (i.e. the vieweris at/near East 46th Street), while “artichokes 3 for $1” mightindirectly (but still potentially usefully) suggest without necessarilydirectly identifying a location (i.e. at a grocery store or otherlocation where artichokes might be for sale). Likewise, overallenvironmental identification might entail identification of multipleobjects, entities, and/or individuals, patterns of landscapes orcityscapes, etc.

Further with regard to steps 114 and 118 in FIG. 1, just as the presentinvention is not particularly limited with regard to the contextualfactors that may be utilized, the present invention also is notparticularly limited with regard to the information that may be obtainedand/or used to determine the status of contextual factors.

As already noted information regarding motion may be gathered; a rangeof such data may be gathered. Motion information regarding the viewermay, for example, be determined by sensing or otherwise obtaining dataon position, velocity, acceleration, orientation, etc. Suitableinstruments for gathering such data include but are not limited toaccelerometers, gyroscopes, compasses, GPS sensors, and differential GPSsensors. In addition, motion data might be obtained in other ways, e.g.by considering image data and determining the motion of the viewerand/or other entities (such as people, objects, etc. in the images)based on position, real and/or apparent motion within the images, etc.In such instances images might be obtained either with or without theviewer therein. For example, to determine motion of a viewer's eyes,hands, mouth, etc. from images it may be useful for those images toinclude the viewer's eyes, hands, mouth, etc. within the images, e.g.using an inward-facing camera. Alternatively, to determine whether aviewer's head or body is moving might be accomplished e.g. with anoutward facing camera so as to sense motion in the changes in the imagesover time as the viewer's head, body, etc. moves relative to theexternal world. These are examples only, and other arrangements may beequally suitable.

Likewise, a range of biometric information may be gathered for use asand/or in support of contextual factors. Biometric information that maybe suitable includes but is not limited to heart rate, heartbeatwaveform, blood pressure, electrical and/or magnetic signals in theheart, brain, individual muscles, and/or body as a whole, skinconductivity, pH, blood chemistry, exhalation chemistry, skin coloration(whether in visible light or otherwise), respiration rate, respirationwaveform, oxygen saturation, electrocardiography, magnetocardiography,electroencephalography, magnetoencephalography, and pupil dilation. Datamay be gathered with and/or without direct contact with an individual,and is not limited either to human subjects or to the viewer(s) (if any)to whom the data is outputted.

As previously noted, some or all phenomena considered as contextualfactors may be evaluated by evaluating higher and/or lower levelphenomena, e.g. determining whether a viewer is walking based on headacceleration, electrical signals in muscles, brainwaves, real/apparentmotion in images, etc.

Similarly, a range of deliberate human activities may be considered asand/or in support of contextual factors. For example, activitiesexecuted by the viewer may be utilized as contextual factors (thoughactivities by others also may be used in addition/instead). Activitiesthat may be considered as contextual factors include, but are notlimited to, sleeping, sitting, standing, walking, running, conversing,exercising, operating a vehicle, and operating machinery.

Continuing with regard to steps 114 and 118 in FIG. 1, it is noted thatcontextual factors are not particularly limited with regard to the useof tools, implements, hardware, etc. In particular, the use of an inputdevice may be utilized as a contextual factor. As has been previouslynoted contextual factors are not particularly limited with regard to thepresence or absence of intent to generate and/or transmit information.Thus although intent is not required for contextual factors to beutilized as input, deliberate efforts to send input such as using aninput device also is permissible. Deliberate inputs that may be suitablefor use as contextual factors include but are not limited to key inputs,mouse inputs, stylus inputs, joystick inputs, a touch inputs, virtualinterface inputs (i.e. utilizing an interface that exists as a virtualconstruct but not necessarily as a physical construct), and brainwavesensor inputs.

Furthermore, phenomena that mimic but do not necessarily constituteother phenomena may themselves be used as contextual factors. Forexample, substantially silent positions and/or motions of lips, jaw,tongue etc. including but not limited to positions and motionssubstantially corresponding to speech may be considered as contextualfactors for the present invention. Similarly, hand gestures having theappearance of using a device such as typing on a non-existent keyboard(and/or a non-physical virtual keyboard), swinging a non-existenthammer, etc. may be utilized as contextual factors. For example, amethod according to the present invention might use motions indicativeof typing as a contextual factor, and limit display of other informationin the viewer's central vision while the viewer is executing suchmotions.

Moreover, as noted briefly earlier herein, contextual factors are notrequired to include input (conscious or otherwise) from a viewer orviewer at all. For example, an environmental condition might be used asa contextual factor.

More particularly, levels of illumination might be utilized as acontextual factor, for example to determine whether to invoke atransformation of the brightness of displayed data (though othertransformations might also be equally suitable). Other environmentconditions suitable for use as contextual factors include, but are notlimited to, color of illumination (and/or the bit depth of the color),the overall brightness and/or color of an area or background, soundlevels, temperature, humidity, wind direction and speed (if any), andthe presence of smoke, rain or other environmental phenomena.

In addition, for at least certain embodiments various abstract notionssuch location may be considered as contextual factors. Such factors maybe considered in absolute terms such as (for location) latitude,longitude, elevation, etc., or in relative terms such as distance anddirection from some reference point. Likewise, location that is indexedbut not necessarily dimensional may be utilized, e.g. a street addressmay be sufficient in at least some instances to specify a location evenwithout dimensional position information. Absolute or relative time(e.g. time measured from some reference), including but not limited toclock time, date, day of the week, year, etc. may also be used as acontextual factor. Other abstract factors also may be equally suitable.

Still with regard to steps 114 and 118 in FIG. 1, objects and entitiesother than a viewer and/or viewer may be utilized as contextual factors.That is, the presence, absence, position, condition, number, behavior,etc. of objects, animals, plants, etc. may be so utilized. For example,the presence, absence, etc. of a wrench might be utilized as acontextual factor. At a relatively low level, such a contextual factormight simply relate to “is such a tool present”, but higher levelconsiderations may also utilize a similar contextual factor, e.g. “whereis the viewer/device/etc.?” In such circumstances, a contextual factorregarding the presence of a wrench might be considered in determininglocation, insofar as a wrench may reasonably be considered to correlatewith a hardware store, construction site, etc., but may be consideredless likely to correlate with a library or movie theater.

Even where contextual factors are concerned with the presence,arrangement, etc. of objects, persons, etc., contextual factors are notlimited to only one object, person, etc. To continue the example above,a high-level contextual factor of “is the viewer in a hardware store”might be considered in terms of a lower-level contextual factor of “arethere multiple wrenches in proximity to one another”. More generally,arrangements, behaviors, etc. of many individual features may beconsidered collectively as contextual factors. Such collectivecombinations of arrangements, behaviors, etc. might be referred to as a“surrounding”. Numerous possible surroundings may be suitable for use ascontextual factors. To continue the previous example, a hardware storemight be considered to be represented by surroundings that might bevisible to a person therein, such as tools, other products, shelves,etc., perhaps with the additional qualification that such features aredisposed in some particular arrangement (or in one of a range ofpossible arrangements). Potentially, very high-level and/or broadcontextual factors such as “where is the viewer” might take intoconsideration a wide range of features, such as local objects nearby,overall coloring, geometries such as building layout or skyline, and/orother information. Such arrangements might enable determinationsregarding contextual factors such as “is the viewer at work?”, “is theviewer at home?”, “is the viewer in a vehicle?”, etc.

Continuing with regard to steps 114 and 118 in FIG. 1, as previouslynoted viewer actions, behavior, etc. may be considered as contextualfactors. Likewise, actions, behavior, etc. of other persons, animals,etc. For example, the presence of a vehicle with a flashing emergencylight (police car, fire truck, etc.) might be used as a contextualfactor to invoke limiting or otherwise altering the output of a headmounted display or other device, e.g. so as to alert a viewer to apotential hazard or emergency, to enable the viewer to more effectivelyrespond thereto (for example by leaving the viewer's central visionunobstructed), etc. Similarly, “another person speaking” might beutilized as a contextual factor, along with a wide range of actions,behaviors, etc. by others.

It will be understood that for a given contextual factor, the nature ofthe contextual factor will determine at least in part the type of datathat is necessary to determine the status thereof, and thus willdetermine at least in part the type of sensors (if any) to be used fordetermining that status. Thus, a contextual factor depending on lightlevels might utilize optical sensors, a contextual factor depending onmotion might utilize an accelerometer, etc. However, status informationmight also be retrieved from a data store, generated by a processor(including but not limited to a processor executing the method of thepresent invention), acquired from an input, etc.

In addition and as previously noted, in determining the status ofcontextual factors it may be useful for at least some embodiments toutilize various recognition capabilities. The nature of recognitioncapabilities (if any) will be determined at least in part by thecontextual factors in question. For example if the presence of an objectis utilized as a contextual factor, then enabling some form of objectrecognition capable of identifying the relevant object may be useful(although perhaps not required, if the object can also/instead beidentified by color, outline, etc.). Recognition capabilities supportiveof determining the status of contextual factors may include but are notlimited to position recognition, motion recognition, accelerationrecognition, face recognition, object recognition, text recognition, andenvironmental recognition.

In addition, determining the status of contextual factors may includeother approaches, such as detection of features that do not necessarilycorrespond directly with objects. For example, detecting a transitionbetween a sky and a cityscape might not necessarily entail recognitionof any particular object or feature, but may still be useful in terms ofdetermining location at a particular city, within a city, etc.Transitions that may be identified in determining the status ofcontextual factors include but are not limited to color transitions,brightness transitions, distance transitions, and focus transitions.

It is emphasized that these are example only, and that the presentinvention is not limited only to recognition and transition detection indetermining the status of contextual factors. Other approaches may beequally suitable.

With regard now to step 124 in FIG. 1, further discussion is hereinpresented regarding transformations to output data in the context of thepresent invention.

As previously described with respect to step 124 in FIG. 1, atransformation is applied therein to the output data (if thedetermination of step 118 in FIG. 1 is positive). The present inventionis not particularly limited with regard to the transformation.

One possible type of transformation of the output data in the presentinvention is to limit the region of a viewer's visual field wherein theoutput data may be displayed. Such an arrangement may or may not alterthe “screen content” of the output data (for cases where the data isthen outputted to a video screen), but does alter the output data atleast insofar as the transformation affects where and/or how the outputdata is outputted. Thus, transformations to the output data are notlimited only to “screen content” or the substance of what data isdisplayed, but also to what might be referred to as “meta data”, i.e.information regarding where the output data is displayed, the resolutionat which the output data is displayed, the coloring, frame rate, etc.For purposes of the present invention, such “meta data” may beconsidered to be part of the output data, and therefor may be subject totransformation.

A very large range of potential transformations may be made within thescope of the present invention. Several examples regardingtransformations limiting where in the viewer's visual field the outputdata may be outputted are presented below, so as to illustrate somepossible transformations. However, it is emphasized that the presentinvention is not limited only to the specific position-relatedtransformations presented as examples herein, nor is the presentinvention limited only to transformations affecting the positioning ofoutput data.

Referring now to FIG. 5, therein a visual map 500 is presented. Thevisual map 500 is at least somewhat similar to the visual map shown inFIG. 2, however, for clarity and simplicity the angular hash marks andlabels are omitted from FIG. 5. The outline identified as 502 in FIG. 5corresponds approximately to a human's peripheral visual field. Theoutline identified as 504 in FIG. 5 corresponds approximately to ahuman's central visual field.

As may be seen, FIG. 5 also shows output data 501 in the form of text.While the present invention is not limited only to text as output data,text is used in FIG. 5 and in several subsequent figures herein as anexample to represent output data 501. As shown in FIG. 5 the output data501 is not restricted as to output location. Output data 501 existswithin the central visual field 504, extends throughout the peripheralvisual field 502, and even beyond the peripheral visual field 502. It isnoted that output data 501 that is outputted beyond the peripheralvisual field 502 may not be visible, since the peripheral fieldsubstantially represents the limits of the human visual field overall.However, the present invention is not necessarily restricted fromoutputting output data 501 outside the human visual field. For example,for output data 501 that is presented as substantially fixed relative toa point in space, a viewer might be able to pan and/or tilt his or hereyes and/or head to view a larger total area than is encompassed by thehuman visual field at any given moment. More with regard to such apan/tilt arrangement is described later herein, but the presentinvention is not limited only to such a pan/tilt arrangement insofar asoutputting output data 501 outside of a viewer's visual field.

With regard to FIG. 6 through FIG. 17, therein output data is shownoutputted as limited to and/or excluded from various regions, such asregions of a viewer's visual field, as might be executed through atransformation according to the present invention. Such outputarrangements may be useful for various purposes. For example, since thehuman visual field has high resolution in the central visual fieldthereof, limiting to the central visual field the output of informationthat requires or benefits from discrimination of fine detail, such astext, may be advantageous under at least some circumstances. Conversely,if the viewer is known or considered likely to be executing someactivity that would require or at least benefit from unobstructedcentral vision, such as walking or running while seeing clearly so as toavoid obstacles and/or hazards, excluding the output of output data tothe central visual field may likewise be advantageous. As anotherexample, since the human peripheral visual field has high sensitivity tolight and motion, limiting to the peripheral visual field the output ofinformation that requires or benefits from high sensitivity to light ormotion, such as directional indicators or high-priority notices, mayalso be advantageous under at least some circumstances.

For at least some embodiments, if a transformation is employed so as tolimit output of information to a particular region of a viewer's visualfield, and/or to otherwise produce an effect that is related to theviewer's visual field and/or some specific region thereof, it may beuseful to utilize eye tracking so as to reliably determine where aviewer is looking, which is to say, how the viewer's visual fields arealigned. More specifically, when outputting for example to one or moredisplays disposed in front of a viewer's eye or eyes, eye tracking maybe useful in determining what portion of the screen(s) represent theperipheral visual field, central visual field, etc. of the viewer, so asto effectively limit output thereto, exclude output therefrom, etc. Insuch an arrangement, the portion of a physical screen that represents,for example, the viewer's central visual field may change over timedepending upon where the viewer looks, so that eye tracking (or someother approach for determining where the viewer is looking) may helpdefine what portion of a physical display or other device correspondssubstantially with the viewer's central visual field. However, sucharrangements are examples only, and neither eye tracking nor other sucharrangements will necessarily be utilized for all embodiments.

Turning specifically to FIG. 6, another visual map 600 is presentedtherein. The visual map 600 is at least somewhat similar to the visualmap shown in FIG. 5, with output data 601, an outline 602 thatcorresponds approximately to a human's peripheral visual field, and anoutline 604 in that corresponds approximately to a human's centralvisual field.

However, as may be seen in FIG. 6, the output data 601 does not appearwithin the peripheral visual field 602. The arrangement in FIG. 6 may bea result, for example, of a transformation applied to output data 601 soas to define an output region and limiting the output of output data 601thereto, with the output region substantially excluding a viewer'speripheral visual field 602.

Now with respect to FIG. 7, another visual map 700 is presented therein.The visual map 700 is again at least somewhat similar to the visual mapshown in FIG. 5, with output data 701, an outline 702 that correspondsapproximately to a human's peripheral visual field, and an outline 704in that corresponds approximately to a human's central visual field.

However, as may be seen in FIG. 7, the output data 701 does not appearwithin the central field of view 704. The arrangement in FIG. 7 may be aresult, for example, of a transformation applied to output data 701 soas to define an output region and limiting the output of output data 701thereto, with the output region substantially excluding a viewer'scentral visual field 704.

As has been described, the present invention is not limited only totransformations that define output regions, and/or limit output theretoand/or exclude output therefrom, or otherwise affect the location ofoutput data. With regard to FIG. 7, it is noted also that the presentinvention, even when so affecting the location of output data, is notlimited to regions defining entire visual fields, or individual visualfields. For example, output to the central visual field 702 is excludedin FIG. 7, although as previously noted the human central visual fieldmay itself be subdivided into the macular, foveal, and fovealar visualfields. Thus in some sense the arrangement of FIG. 7 may be understoodto show exclusion of output from three distinct visual fields. Otherarrangements, including but not limited to defining output location interms of portions of one or more visual fields and/or defining outputlocation in terms unrelated to human visual fields, may be equallysuitable.

Referring now to FIG. 8, a portion of a human visual field is showntherein. The arrangement in FIG. 8 is at least somewhat similar to thearrangement shown in FIG. 3, however, for clarity and simplicity theangular hash marks and labels are omitted from FIG. 8. The outlineidentified as 804 in FIG. 8 corresponds approximately to a human'scentral visual field, while the region outside the central visual field804 corresponds to a portion of a human's peripheral visual field 802.The outline identified as 805 in FIG. 8 corresponds approximately to ahuman's macular visual field, the outline identified as 806 in FIG. 8correspond approximately to a human's foveal visual field, and theoutline identified as 808 in FIG. 8 corresponds approximately to ahuman's foveolar visual field. FIG. 8 also shows output data 801 in theform of text.

As may be seen in FIG. 8, the output data 801 does not appear within themacular visual field 805. The arrangement in FIG. 8 may be a result, forexample, of a transformation applied to output data 801 so as to definean output region and limiting the output of output data 801 thereto,with the output region substantially excluding a viewer's macular visualfield 805.

Moving to FIG. 9, another portion of a human visual field is showntherein. FIG. 9 is again at least somewhat similar to FIG. 3, showing aportion of the peripheral visual field 902, the central visual field904, the macular visual field 905, the foveal visual field 906, and thefoveolar visual field 908, along with output data 901.

However, as may be seen in FIG. 9, the output data 901 does not appearwithin the foveal visual field 906. The arrangement in FIG. 9 may be aresult, for example, of a transformation applied to output data 901 soas to define an output region and limiting the output of output data 901thereto, with the output region substantially excluding a viewer'sfoveal visual field 906.

Turning to FIG. 10, another portion of a human visual field is showntherein. FIG. 10 is again at least somewhat similar to FIG. 3, showing aportion of the peripheral visual field 1002, the central visual field1004, the macular visual field 1005, the foveal visual field 1006, andthe foveolar visual field 1008, along with output data 1001.

However, as may be seen in FIG. 10, the output data 1001 does not appearwithin the foveolar visual field 1008. The arrangement in FIG. 10 may bea result, for example, of a transformation applied to output data 1001so as to define an output region and limiting the output of output data1001 thereto, with the output region substantially excluding a viewer'sfoveolar visual field 1008.

Now with regard to FIG. 11, another visual map 1100 is presentedtherein. The visual map 1100 is at least somewhat similar to the visualmap shown in FIG. 5, with output data 1101, an outline 1102 thatcorresponds approximately to a human's peripheral visual field, and anoutline 1104 in that corresponds approximately to a human's centralvisual field.

However, as may be seen in FIG. 11, the output data 1101 appears onlywithin the peripheral visual field 1102. The arrangement in FIG. 11 maybe a result, for example, of a transformation applied to output data1101 so as to define an output region and limiting the output of outputdata 1101 thereto, with the output region substantially corresponding toa viewer's peripheral visual field 1102.

FIG. 12 also shows a visual map 1200 therein. The visual map 1200 is atleast somewhat similar to the visual map shown in FIG. 11, with outputdata 1201, an outline 1202 that corresponds approximately to a human'speripheral visual field, and an outline 1204 in that correspondsapproximately to a human's central visual field.

As may be seen in FIG. 12, the output data 1201 appears only within theperipheral visual field 1202. The arrangement in FIG. 12 may be aresult, for example, of a transformation applied to output data 1201 soas to define an output region and limiting the output of output data1201 thereto, with the output region substantially corresponding to aviewer's peripheral visual field 1202.

However, while the arrangement of the output data 1201 in FIG. 12 is atleast somewhat descriptively similar to the arrangement in FIG. 11—inboth instances output data appears only within the peripheral visualfield—a comparison of FIG. 11 and FIG. 12 reveals differences in thearrangement of the output data therein. Namely, in FIG. 11 that portionof the output data 1101 that might be expected to align with the centralvisual field 1104 is not displayed. By contrast, in FIG. 12 the outputdata 1201 is positioned and configured differently, such that eventhough no data is displayed within the central visual field 1204 no datais “masked” by the area of non-display corresponding to the centralvisual field 1204.

While in some cases in FIG. 6 through FIG. 17 the display or lack ofdisplay of output data in various areas is shown in simple form, withareas simply blanked out, this is an example only and is presented forpurposes of simplicity. As may be seen from FIG. 12, limiting outputdata 1201 to certain areas and/or excluding output data 1201 fromcertain regions does not necessarily imply truncating, losing, or notdisplaying some portion of the output data. Although so limiting outputdata is not prohibited for the present invention, neither is so limitingoutput data required. Likewise, other transformations may, but are notrequired to, transform output data in a manner as to obstruct, limit,truncate, etc. the output data.

Moving on to FIG. 13, another visual map 1300 is presented therein. Thevisual map 1300 is at least somewhat similar to the visual map shown inFIG. 5, with output data 1301, an outline 1302 that correspondsapproximately to a human's peripheral visual field, and an outline 1304in that corresponds approximately to a human's central visual field.

As may be seen in FIG. 13 the output data 1301 appears only within thecentral visual field 1304. The arrangement in FIG. 13 may be a result,for example, of a transformation applied to output data 1301 so as todefine an output region and limiting the output of output data 1301thereto, with the output region substantially corresponding to aviewer's central visual field 1304.

Turning to FIG. 14, another portion of a human visual field is showntherein. FIG. 14 is at least somewhat similar to FIG. 3, showing aportion of the peripheral visual field 1402, the central visual field1404, the macular visual field 1405, the foveal visual field 1406, andthe foveolar visual field 1408, along with output data 1401.

FIG. 14 also shows an arrangement similar to FIG. 13, in that in FIG. 14the output data 1401 also appears only within the central visual field1404 (collectively the macular visual field 1405, the foveal visualfield 1406, and the foveolar visual field 1408). As with FIG. 13, thearrangement in FIG. 14 may be a result, for example, of a transformationapplied to output data 1401 so as to define an output region andlimiting the output of output data 1401 thereto, with the output regionsubstantially corresponding to a viewer's central visual field 1404.

Now with reference to FIG. 15, another portion of a human visual fieldis shown therein. FIG. 15 is at least somewhat similar to FIG. 3,showing a portion of the peripheral visual field 1502, the centralvisual field 1504, the macular visual field 1505, the foveal visualfield 1506, and the foveolar visual field 1508, along with output data1501.

As may be seen in FIG. 15 the output data 1501 appears only within themacular visual field 1505. The arrangement in FIG. 15 may be a result,for example, of a transformation applied to output data 1501 so as todefine an output region and limiting the output of output data 1501thereto, with the output region substantially corresponding to aviewer's macular visual field 1505.

With regard to FIG. 16, another portion of a human visual field is showntherein. FIG. 16 is at least somewhat similar to FIG. 3, showing aportion of the peripheral visual field 1602, the central visual field1604, the macular visual field 1605, the foveal visual field 1606, andthe foveolar visual field 1608, along with output data 1601.

As may be seen in FIG. 16 the output data 1601 appears only within thefoveal visual field 1606. The arrangement in FIG. 16 may be a result,for example, of a transformation applied to output data 1601 so as todefine an output region and limiting the output of output data 1601thereto, with the output region substantially corresponding to aviewer's foveal visual field 1606.

Now with reference to FIG. 17, another portion of a human visual fieldis shown therein. FIG. 17 is at least somewhat similar to FIG. 3,showing a portion of the peripheral visual field 1702, the centralvisual field 1704, the macular visual field 1705, the foveal visualfield 1706, and the foveolar visual field 1708, along with output data1701.

As may be seen in FIG. 17 the output data 1701 appears only within thefoveolar visual field 1708. The arrangement in FIG. 17 may be a result,for example, of a transformation applied to output data 1701 so as todefine an output region and limiting the output of output data 1701thereto, with the output region substantially corresponding to aviewer's foveolar visual field 1708.

With respect to FIG. 6 through FIG. 17, as has been stated previouslythese illustrations are examples of transformations that may be invokedif the status of a contextual factor is determined to meet a standardtherefor. Spatial and/or position transformations including but notlimited to those illustrated in FIG. 6 through FIG. 17 may be useful forat least certain embodiments of the present invention, and illustrationsthereof are presented herein as examples at least in part of thatpurpose.

However, the present invention is not limited only to thespatial/positional transformations shown as examples in FIG. 6 throughFIG. 17. For example, a transformation that disposes readable textsubstantially below the horizon in a viewer's field of view (e.g. bydefining a first output region that is below that horizon) may besuitable, perhaps in response to a contextual factor relating to whetherthe viewer's head position corresponds to a near-distance readingposition. Other spatial/positional transformations may also be equallysuitable. Moreover, the present invention also is not limited only tospatial and/or positional transformations in general.

Substantially any feature of the output data, and/or of the display orother device or method for outputting the output data, may betransformed as part of a transformation according to the presentinvention. The transformation may include at least a partialdetermination and/or re-determination of at least one property of theoutput data.

As previously noted, transformations may include definition of one ormore output regions, and limiting output thereto and/or excluding outputtherefrom. Such output regions may, but are not required to, correspondwith one or more anatomical and/or functional regions of a viewer'svisual field.

Where multiple transformations are utilized, transformations may beidentical, similar, or entirely distinct from one another. As an exampleof multiple transformations, a first transformation might define a firstoutput region and limit output of the output data thereto or excludeoutput therefrom, while a second transformation might define a secondoutput region and limit output of the output data thereto or excludeoutput therefrom. As a more particular example, a first transformationmight define a first output region that corresponds to the viewer'scentral visual field (thus excluding the peripheral visual field) andlimiting output data thereto, while the second transformation mightdefine a second output region that corresponds to the viewer'speripheral visual field (thus excluding the central visual field) andlimiting output data thereto. (More description regarding invokingmultiple transformations is provided subsequently herein.)

A transformation may include definition of one or more subsets of theoutput data, with output being limited only to the subset or subsets.That is, the output data might be truncated or otherwise reduced as partof the transformation.

Transformations may include multiple changes to multiple features of theoutput data. To continue the example of generating subsets of outputdata, a transformation might define first and second subsets of outputdata, and may also generate first and second output regions, limitingoutput of the first subset to the first output region and the secondsubset to the second output region.

Transformations may also include, but are not limited to, at leastpartial determination (and/or re-determination) of the presence ofoutput data, the location of output data, the size of output data, anabridgement (or lack of same) of output data, the dimensionality ofoutput data (e.g. changing between two dimensional and threedimensional, etc.), the resolution of output data, the color of outputdata (including but not limited to bit depth and other colorproperties), the brightness of output data, the contrast of output data,the transparency and/or opacity of output data, the motion of outputdata, the animation and/or animation properties of output data (if any),and the frame rate of output data. The above are examples only, andother properties may be equally suitable for determination and/orre-determination through transformations according to the presentinvention.

As has also been noted, the present invention is not particularlylimited with regard to the type, form, and/or quantity of output datathat is generated, transformed, and/or outputted. As examples, outputdata (whether before or after transformation) may include but is notlimited to text, graphics, images, video, image augmentations, andsound.

Where output data is generated partially or entirely from input data,output data (whether before or after transformation) may include all ofthe input data, some of the input data, or none of the input data.Moreover, the output data may be an empty set. That is, whether beforeor after transformation, no output data is required to be eithergenerated or transformed or outputted.

Further with regard to outputting data, it is noted that with or without(and before or after) transformation, output data in the presentinvention may vary considerably within the present invention. Forexample, as previously noted output data may be generated and/oroutputted in an arrangement that exceeds the visual field of the viewerat any given time. Panning, tilting, angling, etc. of the head by theviewer may then reveal more and/or different portions of the outputdata. Such an arrangement is illustrated in FIG. 18 through FIG. 21.

With regard to FIG. 18, therein a visual map 1800 is presented. Theoutline identified as 1804 in FIG. 5 corresponds approximately to ahuman's peripheral visual field. The outline identified as 1802 in FIG.5 corresponds approximately to a human's central visual field. Outputdata 1801 in the form of text exists within the visual map.

As may be seen, the central visual field 1804 and peripheral visualfield 1802 combined, representing substantially a human eye's entirevisual field, encompass only a portion of the output data 1801.

Moving now to FIG. 19, another visual map 1900 is presented, again witha central visual field 1904, a peripheral visual field 1902, and outputdata 1901. However, as may be seen from a comparison with FIG. 18, inFIG. 19 the central visual field 1904 and peripheral visual field 1902are shifted to the left (panned), resulting in a different portion ofthe input data 1901 being within the central visual field 1904 andperipheral visual field 1902. This may be a result of the output data1901 being outputted so as to be substantially fixed relative to somepoint, with the viewer then panning his or her sight to the left.Alternately, this may be considered to represent a viewer panning to theleft, with the output data 1901 then being shifted correspondingly in anopposite direction (right), i.e. as displayed on a head mounted displayscreen, so as to present the appearance of the output data beingsubstantially fixed.

In such an arrangement, the combination of the central visual field 1904and the peripheral visual field 1902 may be considered collectively as amoveable “window” onto a larger arrangement of output data 1901. Inpractice, only that portion of the output data 1901 that is within thewindow (in the case of FIG. 19 the combined central visual field 1904and the peripheral visual field 1902) may be outputted at any giventime, although outputting more than such a window could accommodate alsois not prohibited.

Similarly in FIG. 20, another visual map 2000 is presented, again with acentral visual field 2004, a peripheral visual field 2002, and outputdata 2001. However, as may be seen from a comparison with FIG. 18, inFIG. 20 the central visual field 2002 and peripheral visual field 2004are shifted to the left (tilted, or elevated), resulting in yet adifferent portion of the input data 2001 being within the central visualfield 2004 and peripheral visual field 2002. This may be a result of theoutput data 2001 being outputted so as to be substantially fixedrelative to some point, with the viewer then tilting his or her sightupward. Alternately, this may be considered to represent a viewertilting upward, with the output data 2001 then being shiftedcorrespondingly in an opposite direction (downward) so as to present theappearance of the output data being substantially fixed.

Likewise with reference to FIG. 21, another visual map 2100 ispresented, again with a central visual field 2104, a peripheral visualfield 2102, and output data 2101. However, as may be seen from acomparison with FIG. 18, in FIG. 21 the central visual field 2102 andperipheral visual field 2104 are shifted substantially about the centralvision (inclined counterclockwise), resulting in still a differentportion of the input data 2101 being within the central visual field2104 and peripheral visual field 2102. This may be a result of theoutput data 2101 being outputted so as to be substantially fixedrelative to some point, with the viewer then inclining his or her sightcounterclockwise. Alternately, this may be considered to represent aviewer inclining counterclockwise, with the output data 2101 then beingshifted correspondingly in an opposite direction (clockwise) so as topresent the appearance of the output data being substantially fixed.

Although FIG. 18 through FIG. 21 are presented with moveable “windows”corresponding substantially with human central and peripheral visualfields, this is an example only. Other window arrangements may beequally suitable.

Other output features and arrangements may likewise be useful for atleast certain applications. For example, for stereo output dataoutputted using a stereo display, it may be advantageous for at leastsome embodiments to define a natural convergence for the stereo outputdata that substantially corresponds to a natural reading position, andoutputting the output data therewith.

Yet another feature that may be utilized with and/or as part of theoutput data is the presence of one or more markers. For example, amarker such as a cursor might be outputted so as to be substantiallyfixed relative to the field of view of the viewer. Such an arrangementis illustrated in FIG. 22. Therein a visual map 2200 is presented, witha central visual field 2104, a peripheral visual field 2202, output data2201 in the form of text, and a marker 2209 in the form of a cursordisposed within the central visual field 2204.

With regard to FIG. 23 through FIG. 29, the present inventionencompasses a number of variations to the basic method as illustratedfor example in FIG. 1 and FIG. 4. FIG. 23 through FIG. 29 showadditional example arrangements of methods according to the presentinvention, although it is emphasized that the arrangements shown thereinare examples and that the present invention is not limited thereto.

With reference now specifically to FIG. 23, as has been noted previouslythe present invention may utilize multiple transformations, and/or mayinvoke different transformations under different circumstances. One suchexample arrangement is shown in FIG. 23, wherein a first transformationis applied if the status of a contextual factor meets a standardtherefor, while a second transformation is applied if the status doesnot meet the standard.

In the method as shown in FIG. 23, input data is obtained 2310. Outputdata is generated 2312. A status of a contextual factor is determined2314.

A determination is made 2318 as to whether the status of the contextualfactor (as determined in step 2314) meets a standard for that contextualfactor. If the determination 2318 is positive—if the contextual factormeets the standard—then a first transformation is applied 2324 to theoutput data. However, if the determination is negative—if the contextualfactor does not meet the standard—then a second transformation isapplied 2326 to the output data.

The output data is then outputted 2330.

With reference now to FIG. 24, therein another example arrangement isshown wherein a first transformation is applied if the status of acontextual factor meets a standard therefor, while a secondtransformation is applied if the status does not meet the standard.

In the method as shown in FIG. 24, input data is obtained 2410, outputdata is generated 2412, and a status of a contextual factor isdetermined 2414.

A determination is made 2418 as to whether the status of the contextualfactor (as determined in step 2414) meets a standard for that contextualfactor. If the determination 2418 is positive, then a first region isdefined 2424A, and the output of output data is limited 2424B to thatfirst region. Collectively, steps 2424A and 2424B may be considered tobe a first transformation. On the other hand, if the determination isnegative, then a second region is defined 2426A and the output of outputdata is limited 2426B to that second region.

The output data is then outputted 2430. From the standpoint of a viewer,if the status of the contextual factor meets the standard (whether ornot the viewer is aware of the contextual factor, the status thereof,and/or the standard), then the output data appears in one region, whileif the status of the contextual factor does not meet the standard, theoutput data appears in another region. For example, data might beoutputted to the viewer's central vision (e.g. on a head mounteddisplay) if the standard is met, and outputted to the viewer'speripheral vision if the standard is not met.

Turning to FIG. 25, therein an example arrangement is shown wherein afirst transformation splits data output into two distinct regions. Inthe method as shown in FIG. 25, input data is obtained 2510, output datais generated 2512, and a status of a contextual factor is determined2514.

A determination is made 2518 as to whether the status of the contextualfactor (as determined in step 2514) meets a standard for that contextualfactor. If the determination 2518 is negative, the method proceeds tooutput the output data 2530.

However, if the determination is positive, several steps are executed.First and second regions are defined 2524A. First and second output datasubsets also are defined 2524B. Output of both subsets is then limited2524C, the first subset being limited to output in the first region, andthe second subset being limited to output in the second region. Theoutput data (rather, the first and second subsets thereof) is thenoutputted 2530.

As previously noted, subsets of the output data may include some or allof the full output data, and may or may not include additional data aswell. Thus not all of the output data is necessarily outputted in eitheror both subsets; some portion of the output data may not be outputted atall in view of the transformation. In addition, since it is possiblethat the first and second subset may (depending on the transformation)include some of the same output data, some portion of the output datamay be outputted twice (in both the first and the second subsets).

While the arrangement in FIG. 25 is somewhat similar to that in FIG. 24in that both result in output data may appear in either of two definedregions, in the arrangement of FIG. 24 the output data either appears ina first region or a second region, while in the arrangement of FIG. 25the output data is split into two subsets (assuming the status of thecontextual factor is determined to meet the standard therefor, as shown)with one subset being outputted to a first region and another subsetbeing outputted to a second region.

Now with reference to FIG. 26, an example arrangement is shown thereinwith only a first subset of the output data being outputted. In themethod as shown in FIG. 26, input data is obtained 2610, output data isgenerated 2612, and a status of a contextual factor is determined 2614.

A determination is made 2618 as to whether the status of the contextualfactor (as determined in step 2614) meets a standard for that contextualfactor. If the determination 2618 is negative, the method proceeds tooutput the output data 2630.

However, if the determination is positive, a first output data set isdefined 2624A, and output of the output data is limited 2624B to thatfirst subset. The output data (rather, the first subset thereof) is thenoutputted 2630.

With regard to FIG. 27 through FIG. 29, as noted previously the presentinvention may include two or more contextual factors, statusdeterminations, standards, and/or transformations invoked thereby. Whentwo or more transformations are invoked, the relative precedence of thetransformations may be significant. That is, if two transformations havethe potential to produce different effects on the output data, someconsideration may be useful in so far as which transformation(s) and/orwhich portions thereof are implemented. FIG. 27 through FIG. 29 presentthree examples of arrangements for managing multiple transformations,with each such figure showing an example wherein a different degree ofprecedence exists between the first and second transformations.

Now particularly with reference to FIG. 27, therein an examplearrangement is shown wherein a first and second transformations havesubstantially equal precedence. In the method as shown in FIG. 27, inputdata is obtained 2710 and output data is generated 2712. A status of afirst contextual factor is determined 2714, and the status of a secondcontextual factor is determined 2716.

A first determination is made 2718 as to whether the status of the firstcontextual factor (as determined in step 2714) meets a first standard.Regardless of whether the status first contextual factor is determined2718 to meet the standard or not, a second determination is also made2720A or 2720B as to whether the status of the second contextual factor(as determined in step 2716) meets a second standard. Thus, four pathsare possible within the method as shown.

If the first determination 2718 is negative and the second determination2720A is also negative, the method proceeds to output the output data2730.

If the first determination 2718 is negative but the second determination2720A is positive, a second transformation is applied 2726 to the outputdata, and the method then proceeds to output the output data 2730.

If the first determination 2718 is positive but the second determination2720B is negative, a first transformation is applied 2724 to the outputdata, and the method then proceeds to output the output data 2730.

If the first determination 2718 is positive and the second determination2720B is positive, both the first and second transformations are applied2722 to the output data, and the method then proceeds to output theoutput data 2730.

As noted, for the arrangement in FIG. 27 the first and secondtransformations have substantially equal precedence. Thus, either orboth transformations may be applied to and/or affect the output data.

Turning to FIG. 28, therein an example arrangement is shown with a firsttransformation having full precedence over a second transformation. Inthe method as shown in FIG. 28, input data is obtained 2810 and outputdata is generated 2812. A status of a first contextual factor isdetermined 2814, and the status of a second contextual factor isdetermined 2816.

A first determination is made 2818 as to whether the status of the firstcontextual factor (as determined in step 2814) meets a first standard.If the first determination is positive, a first transformation isapplied 2824 to the output data. The output data is then outputted 2830.In such cases wherein the status of the first contextual factor meetsthe first standard, the status of the second contextual factor may noteven be considered. In practice, for some embodiments the firstdetermination 2818 as to whether the status of the first contextualfactor meets the first standard may be made before the status of thesecond factor is determined 2816, since the outcome of the firstdetermination may render the status of the second contextual factormoot.

If the first determination is negative, a second determination is madeas to whether the status of the second contextual factor (as determinedin step 2816) meets a second standard. If the second determination isalso negative, the method proceeds to output the output data 2830.However, if the second determination is positive, a secondtransformation is applied to the output data 2826 before the output datais outputted.

As noted, for the arrangement in FIG. 28 the first transformation hasfull precedence over the second transformation. If the firsttransformation is executed, the second transformation is not executed.

Turning now to FIG. 29, therein an example arrangement is shown with afirst transformation having partial precedence over a secondtransformation. In the method as shown in FIG. 29, input data isobtained 2910 and output data is generated 2912. A status of a firstcontextual factor is determined 2914, and the status of a secondcontextual factor is determined 2916.

A second determination is made 2920 as to whether the status of thesecond contextual factor (as determined in step 2916) meets a secondstandard. If the second determination is positive, a secondtransformation is applied 2926 to the output data. If the seconddetermination is negative, the second transformation is not applied. Ineither event, a first determination is also made 2918 as to whether thestatus of the first contextual factor (as determined in step 2914) meetsa first standard. If the first determination is positive, a firsttransformation is applied 2922 to the output data (as potentiallyalready transformed by the second transformation). If the firstdetermination is negative, the first transformation is not applied. Inany event, the method proceeds to output the output data 2930.

As illustrated and described in FIG. 29, the second determination and/orthe second transformation may take place before the first determinationand/or the first transformation. This is presented as an example onlyfor purposes of illustrating precedence, and does not necessarily implya strict chronology. The chronological order of the first and secondtransformations is not necessarily significant in itself. Rather,because the first transformation has partial precedence over the secondtransformation, the first transformation is able to partially orcompletely undo, counter, and/or or override the second transformation,and/or to limit the second transformation, should a conflict between thefirst and second transformations exist.

With reference now to FIG. 34, an example embodiment of a methodaccording to the present invention is shown. As noted, at least someembodiments of the present invention are machine-controlled methods. Inthe example embodiment of FIG. 34, an arrangement is shown wherein amethod is established within a processor, for executing a method forselectively presenting content according to the present invention.

In the method of FIG. 34, a contextual factor is defined 3470. Thesource of the contextual factor is not particularly limited. Thecontextual factor may for example be viewer-defined, may be determinedby a controlling processor, may be read from a data store, may bereceived from an external source, etc. Other arrangements may be equallysuitable. The nature of the contextual factor also is not particularlylimited.

A standard for the contextual factor also is defined 3472. As with thecontextual factor, the source of the standard therefor is notparticularly limited. The standard may for example be viewer-defined,may be determined by a controlling processor, may be read from a datastore, may be received from an external source, etc. Other arrangementsmay be equally suitable. The nature of the standard also is notparticularly limited.

In addition, a transformation for output data is defined 3474. Again,the source of the transformation is not particularly limited. Thetransformation may for example be viewer-defined, may be determined by acontrolling processor, may be read from a data store, may be receivedfrom an external source, etc. Other arrangements may be equallysuitable. The nature of the transformation also is not particularlylimited.

Executable instructions for determining the status of the contextualfactor are instantiated 3476 onto a controlling processor. The manner bywhich the determination is made is not particularly limited, nor are theexecutable instructions therefor.

Executable instructions for obtaining input data are instantiated 3478onto the controlling processor. The source for obtaining the input datais not particularly limited, nor is the manner of obtaining the inputdata, nor are the executable instructions therefor. For some embodimentsthe executable instructions may cause the controlling processor toobtain input data from one or more sensors, to generate input datainternally, to read input data from a data store, to receive input datafrom an external source, etc. Other arrangements may be equallysuitable.

Executable instructions for generating output data, e.g. from the inputdata, are instantiated 3480 onto the controlling processor. The mannerby which the output data is generated is not particularly limited, norare the executable instructions therefor.

Executable instructions for comparing the status of the contextualfactor with the standard defined therefor (in step 3472) areinstantiated 3482 onto the controlling processor. The manner ofcomparison and the instructions therefor are not particularly limited.

Executable instructions for applying the transformation (defined in step3474) to the output data are instantiated 3484 onto the controllingprocessor, with the transformation being contingent on whether thestatus of the contextual factor meets the standard therefor. The mannerof executing the transformation is not particularly limited.

Executable instructions for outputting the output data (whether or notthe transformation is applied thereto) are instantiated 3486 onto thecontrolling processor. The manner of outputting the output data is notparticularly limited.

With reference now to FIG. 30, an embodiment of an apparatus 3050 forselectively presenting content is shown. The example apparatus asillustrated includes a processor 3052, a sensor 3054 in communicationwith the processor 3052, and a display 3056 in communication with theprocessor 3052.

The sensor 3054 is adapted to sense at least one contextual factor. Thesensor 3054 may be, but is not required to be, adapted to generate someor all input data (if any) used by the processor 3052.

The processor 3052 is adapted to determine a status of the contextualfactor as sensed by the sensor 3054. The processor 3052 is also adaptedto determine if the contextual factor meets a standard. The processor3052 is further adapted to generate output data, e.g. from input datasupplied thereto, and to apply a transformation to the output data ifthe contextual factor meets the standard.

The display 3056 is adapted to output the output data to a viewer.

A range of devices may be suitable for use as the sensor 3054. Asillustrated in FIG. 30, the sensor 3054 is shown as an imaging sensorsuch as a camera, adapted to capture images and/or video. A range ofcameras, including but not limited to CMOS and CCD cameras, may besuitable. However, the use of a camera or other imaging sensor as asensor 3054 for the apparatus 3050 is an example only. Other sensors maybe equally suitable, such as sensors that capture information other thanimages and/or video may be equally suitable. Other suitable sensors 3054may include but are not limited to position sensors, motion sensors,acceleration sensors, and biometric sensors. More particular sensors3054 may include but are not limited to accelerometers, gyroscopes,compasses, GPS sensors, and differential GPS sensors.

The sensor 3054 is not particularly limited with regard to either whatprecise context factor(s) may be sensed, or how the sensor 3054 maysense the contextual factor(s).

Similarly, a range of general-purpose, special-purpose, and embeddedsystems may be suitable for use as the processor 3052. Moreover, it maybe equally suitable for the processor 3052 to consist of two or morephysical or logical processor components.

A range of devices likewise may be suitable for use as the display 3056,including but not limited to light emitting diodes (LED), organic lightemitting diodes (OLED), plasma screen panels (PDP), liquid crystaldisplays (LCD), etc. Likewise, the use of projected or transmitteddisplays, where the viewed surface (if any) is essentially a passivescreen for an image projected or otherwise transmitted after beinggenerated elsewhere, may also be suitable. Other arrangements includingbut not limited to systems that display images directly onto a viewer'seyes also may also be suitable. Either digital or analog displaytechnologies may be suitable.

The apparatus may vary considerably from one embodiment to another, inways including but not limited to the following.

Turning to FIG. 31, an example apparatus 3150 is shown having stereosensors 3154A and 3154B, adapted to generate stereo information, incommunication with a processor 3152. Such a sensor arrangement may beuseful for at least some embodiments, at least in that stereo imagingcan provide three dimensional data regarding an environment, e.g. bycapturing images (or other data) from slightly different perspectives soas to provide distance information, etc. However, the use of stereosensors 3154A and 3154B is an example only, and other arrangements maybe equally suitable.

The apparatus 3150 also includes stereo displays 3156A and 3156B,adapted to output stereo output data, in communication with theprocessor 3152. Such a display arrangement may be useful for at leastsome embodiments, at least in that stereo output can display threedimensional data to a viewer, e.g. by outputting slightly differentperspectives to left and right displays 3156A and 3156B (and thus toleft and right eyes). However, the use of stereo displays 3156A and3156B is an example only, and other arrangements may be equallysuitable.

With reference now to FIG. 32, an apparatus 3250 is shown having aprocessor 3252, a sensor 3254, and a display 3256, at least somewhatsimilar to FIG. 30. However, the example apparatus in FIG. 32 alsoincludes a data store 3258 in communication with the processor 3252. Thedata store 3258 is adapted to store input data and/or to storeinformation regarding the status of one or more contextual factors, andto communicate such information with the processor 3252.

A variety of devices may be suitable for use as the data store 3258.Suitable devices may include but are not limited to magnetic harddrives, optical drives, and solid state drives. Other devices and/orsystems may be equally suitable.

The apparatus 3250 also includes a communicator 3260 in communicationwith the processor 3252. The communicator 3260 is adapted to receiveinput data and/or information regarding the status of one or morecontextual factors from some source external to the apparatus 3250. Thecommunicator 3260 also may be, but is not required to be, adapted totransmit information to some destination external to the apparatus 3250.

A variety of devices also may be suitable for use as the communicator3258. Communication may be wired and/or wireless. Suitable devices mayinclude but are not limited to wired and wireless modems.

As noted above with regard to the individual elements, any or all of asensor, a data store, and/or a communicator may provide input dataand/or information regarding contextual factors to a processor in anapparatus according to the present invention. Thus, arrangements withonly a sensor, only a data store, and/or only a communicator may besuitable for at least some embodiments. However, combinations of one ormore sensors, one or more data stores, and/or one or more communicatorsalso may be suitable, and the present invention is not particularlylimited with respect thereto.

The present invention may be incorporated into and/or utilized with abroad range of other devices. For example, FIG. 33 shows an arrangementof an apparatus 3350 in accordance with the present invention asincorporated with a head mounted display. The embodiment shown in FIG.33 includes a processor 3352, first and second sensors 3354A and 3354Bin a stereo arrangement, and first and second displays 3356A and 3356Balso in a stereo arrangement. The apparatus 3350 also includes a datastore 3358 and a communicator 3360.

The apparatus shown in FIG. 33 also includes a body 3362 in the form ofa frame for a head mounted display. As shown the body 3362 resembles apair of glasses, but this is an example only, and other configurationsmay be equally suitable.

As may be seen, the first and second sensors 3354A and 3354B aredisposed so as to be generally forward-facing similarly to a viewer'seyes. Typically, although not necessarily, the first and second sensors3354A and 3354B will have imaging fields of view at least sufficient soas to substantially encompass the visual field of a viewer. While theimaging fields of view of the first and second sensors 3354A and 3354Bmay potentially extend beyond the visual field of the viewer, withsufficiently large angles of view for the first and second sensors 3354Aand 3354B the images obtained therefrom will at least include imagingfields of view substantially corresponding the with a viewer's visualfield. However, such an arrangement is an example only, and otherarrangements may be equally suitable.

The displays 3356A and 3356B are engaged with the body 3362, with thebody 3362 being configured and the displays 3356A and 3356B beingdisposed such that when viewer wears the apparatus 3350, the displays3356A and 3356B are disposed proximate to and substantially aligned withthe viewer's eyes. The sensors 3354A and 3354B are engaged with the body3362, as are the processor 3352, the data store 3358, and thecommunicator 3360.

Although as shown in FIG. 33 the sensors 3354A and 3354B are engagedwith the body 3362 such that both sensors 3354A and 3354B face generallyaway from the viewer when the viewer wears the apparatus 3350, this isan example only and is not required. Arrangements wherein one or moresensors are disposed so as to face toward the viewer, and/or are indirect contact with the viewer, may be equally suitable.

The above specification, examples, and data provide a completedescription of the manufacture and use of the composition of theinvention. Since many embodiments of the invention can be made withoutdeparting from the spirit and scope of the invention, the inventionresides in the claims hereinafter appended.

We claim:
 1. A machine implemented method, comprising: obtaining input data; generating output data from said input data; determining a status of at least a first contextual factor; determining whether said status of said first contextual factor meets a first standard; if said status of said first contextual factor meets said first standard, applying a first transformation to said output data; outputting said output data in a form suitable for display to a viewer.
 2. The method of claim 1, comprising: if said status of said first contextual factor does not meets said first standard, applying a second transformation to said output data.
 3. The method of claim 2, wherein: said first transformation comprises definition of a first output region and limiting output of said output data thereto; and said second transformation comprises definition of a second output region and limiting output of said output data thereto.
 4. The method of claim 3, wherein: said first output region substantially corresponds to a central visual field of said viewer and substantially excludes a peripheral visual field of said viewer; and said second output region substantially corresponds to said peripheral visual field of said viewer and substantially excludes said central visual field of said viewer.
 5. The method of claim 1, wherein: said first transformation comprises definition of a first subset of said output data with output of said output data limited to output of said first subset.
 6. The method of claim 1, wherein: said first transformation comprises: definition of a first subset of output data; definition of a second subset of output data; definition of a first output region with output of said first subset limited thereto; and definition of a second output region with output of said second subset limited thereto.
 7. The method of claim 1, wherein: said transformation comprises at least partial determination of at least one of a group consisting of a presence, a location, a size, an abridgment, a dimensionality, a resolution, a color, a brightness, a contrast, a transparency, a motion, a speed, an animation, and a frame rate of said output data.
 8. The method of claim 1, wherein: said output data comprises at least one of a group consisting of text, graphics, images, video, and image augmentation.
 9. The method of claim 1, wherein: said output data comprises sound.
 10. The method of claim 1, wherein: said output data comprises all of said input data.
 11. The method of claim 1, wherein: said output data comprises some of said input data.
 12. The method of claim 1, wherein: said output data comprises none of said input data.
 13. The method of claim 1, wherein: said output data is an empty set.
 14. The method of claim 1, wherein: if said status of said first contextual factor does not meet said standard, generating said output data comprises incorporating some but not all of said input data in said output data; said first contextual factor comprises a head motion toward at least a portion of said output data as outputted; and said first transformation comprises incorporation of all of said input data in said output data.
 15. The method of claim 1, wherein: said first contextual factor comprises a head motion of said viewer; said first transformation comprises definition of a first output region substantially excluding a central vision of said viewer with output of said output data limited thereto.
 16. The method of claim 1, comprising: determining a status of a second contextual factor; determining whether said status of said second contextual factor meets a second standard; if said second contextual factor meets said second standard, applying a second transformation to said output data.
 17. The method of claim 16, wherein: said first transformation has priority over said second transformation, such that if said first contextual factor meets said first standard and said second contextual factor meets said second standard then only said first transformation is applied to said output data.
 18. The method of claim 16, wherein: said first transformation has priority over said second transformation, such that if said first contextual factor meets said first standard and said second contextual factor meets said second standard then said second transformation is limited by said first transformation.
 19. The method of claim 16, wherein: said first transformation has priority over said second transformation, such that if said first contextual factor meets said first standard and said second contextual factor meets said second standard then said second transformation is at least partially countered by first second transformation.
 20. The method of claim 19, comprising: said first contextual factor comprises a head motion substantially corresponding with locomotion of said viewer; wherein: said first transformation comprises definition of a first output region substantially excluding a central vision of said viewer with output of said output data limited thereto; said second transformation comprises definition of said first output region substantially including said central vision of said viewer.
 21. The method of claim 20, wherein: said second contextual factor comprises at least one of a group consisting of an abrupt head motion not substantially corresponding with locomotion of said viewer, a substantially vertical head nodding motion not substantially corresponding with locomotion of said viewer, and a substantially horizontal head shaking motion not substantially corresponding with locomotion of said viewer.
 22. The method of claim 1, wherein: said first contextual factor comprises a head position of said viewer substantially corresponding to a near-distance reading position; and said first transformation comprises definition of a first output region substantially below a horizon of a field of view of said viewer with output of said output data limited thereto.
 23. The method of claim 22, comprising: outputting said output data in a stereo format; wherein said first transformation further comprises definition of a natural convergence substantially corresponding to a natural reading position with said output data displayed therewith.
 24. The method of claim 1, comprising: outputting said output data in a region extending beyond a visual field of a viewer, such that said visual field of said viewer comprises a window of said output data, and such that moving said visual field of said viewer substantially correspondingly moves said window relative to said output data.
 25. The method of claim 1, comprising: outputting a marker substantially fixed relative to a visual field of said viewer, said marker moving substantially correspondingly with said visual field of said viewer.
 26. The method of claim 25, wherein: said marker comprises a cursor. 